Theil-Sen Estimators in a Multiple Linear Regression Model
نویسندگان
چکیده
In this article, we propose the Theil-Sen estimators of parameters in a multiple linear regression model based on a multivariate median, generalizing the Theil-Sen estimator in a simple linear regression model. The proposed estimator is shown to be robust, consistent and asymptotically normal under mild conditions, and super-efficient when the error distribution is discontinuous. It can be chosen to satisfy the prespecified possible robustness and efficiency. Simulations are conducted to compare robustness and efficiency with least squares estimators and to validate super-efficiency. Additionally we obtain a sufficient and necessary condition which characterizes the symmetry of a random vector.
منابع مشابه
The Asymptotics of the Mahalanobis Depth-Based Theil-Sen Estimators in Multiple Linear Models
In this article, we propose the use of the Mahalanobis depth to construct fully affine equivalent Theil-Sen estimators of parameters in a multiple linear model. Our construction includes the spatial depth-based Theil-Sen estimators as a special case. We exhibit that the efficiency of the proposed estimators relative to the least squares estimators increases with the number of parameters under i...
متن کاملRobust Regression Estimators When There are Tied Values
There is a vast literature on robust regression estimators, the bulk of which assumes that the dependent (outcome) variable is continuous. Evidently, there are no published results on the impact of tied values in terms of the Type I error probability. A minor goal in this paper to comment generally on problems created by tied values when testing the hypothesis of a zero slope. Simulations indic...
متن کاملConsistency and Asymptotic Distribution of the Theil-Sen Estimator
In this paper, we obtain the strong consistency and asymptotic distribution of the Theil-Sen estimator in simple linear regression models with arbitrary error distributions. We show that the Theil-Sen estimator is super-efficient when the error distribution is discontinuous and that its asymptotic distribution may or may not be normal when the error distribution is continuous. We give an exampl...
متن کاملPositive-Shrinkage and Pretest Estimation in Multiple Regression: A Monte Carlo Study with Applications
Consider a problem of predicting a response variable using a set of covariates in a linear regression model. If it is a priori known or suspected that a subset of the covariates do not significantly contribute to the overall fit of the model, a restricted model that excludes these covariates, may be sufficient. If, on the other hand, the subset provides useful information, shrinkage meth...
متن کاملComparing Robust Regression Lines Associated with Two Dependent Groups When There Is Heteroscedasticity
The paper deals with three approaches to comparing the regression lines corresponding to two dependent groups when using a robust estimator. The focus is on the Theil–Sen estimator with some comments about alternative estimators that might be used. The first approach is to test the global hypothesis that the two groups have equal intercepts and slopes in a manner that allows a heteroscedastic e...
متن کامل